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Method and Apparatus for Accessing Content 



CROSS-REFERENCES TO RELATED APPLICATIONS 
The present application is related to and claims priority from Japanese 
Patent Application No. 1 1-372672, filed on December 28, 1999. 

BACKGROUND OF THE INVENTION 
The present invention relates to a device for recording image information 
to a medium or a device for playing back image information from a medium. 

Examples of systems for playing back image information recorded on 
media include VCRs, which have been in use for a long time, as well as video CDs, 
which use an optical disk with a 12cm diameter as the recording medium. Recently, 
DVDs, which use an optical disk with the same diameter but with approximately seven 
times the recording capacity, have emerged. 

In DVD playback devices, numbers are assigned to: recorded programs (in 
DVDs, these are called "titles" and will be referred to as such below); the plurality of 
scenes contained in a title (in DVDs, these are called "chapters" and will be referred to as 
such below); and fi-ames, which are the basic units of the images. Cueing, where a 
desired image is displayed at the beginning, is accomplished by entering a title number, a 
chapter number, and a frame number for a desired image, determining a playback position 
on the disk, and playing back images beginning with this position (e.g., see Japanese laid- 
open patent publication number Hei 7-3 1 2737). 

Also, when multiple sets of supplementary information (e.g., "multi-angle" 
information containing multiple images from different perspectives, separate left and 
right channels of audio, and different languages such as Japanese and EngUsh) are 
recorded simultaneously with the images, and playback conditions are selected by 
selecting which supplementary information to use. The selection of playback conditions 
is performed by switching between screens for each set of information and checking the 
contents of each. Supplementary information can also be recorded beforehand on the disk 
as a menu of playback conditions (e.g., see Japanese laid-open patent publication number 
8-251531). 

The conventional technologies described above are effective in cases, such 
as with karaoke disks, where the producer of a disk deliberately assigns numbers (e.g.. 
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numbers are assigned according to the sequence of songs) and the documentation or the 
like for the disk indicates the meaning associated with the numbers. However, this does 
not provide effective means for selecting if a user attempts to access images without the 
documentation. This makes accessing and searching an arbitrary position on a disk 
difficuh. Also, it is not possible to look through the multiple sets of supplementary 
information all at once, thus making selection time consuming. Furthermore, if a menu 
for the information is recorded beforehand, the method used to display and select the 
information will vary according to the intentions of the program producers. This is 
inconvenient since each disk will involve a different method. 

Also, knowing the overall content of a stream (where a stream is the 
information for a series of connected scenes) is difficult. 

There is a need to overcome the problems of the conventional technology 
described above and to provide a novel information playback device that allows easy 
searching of information through unified operations and that allows the contents of all or 
at least part of a stream to be perceived and selected from a playback screen. 

SUMMARY OF THE INVENTION 

An information playback device comprises a driver module for accessing 
content on a storage medium. The content is organized into a plurality of programs, each 
program comprising a plurality of segments, each segment comprising a plurality of 
frames. A decoder module is operatively coupled to the driver module to receive an 
information signal from the driver module. A user input module is provided for receiving 
user input. A system control module controls the driver and decoder modules produce a 
display signal representing the programs on the storage medium. In response to receiving 
a user-selected program, the system control module further controls the driver and 
decoder modules to access a representative frame from each scene of the user-selected 
program and to produce a second display signal representing the representative frames. 
In response to receiving a user command, the system control module controls the driver 
and decoder modules accordingly to produce a third signal representing one or more 
frames from a scene corresponding to a user-selected one of the representative frames. 

In an embodiment of the invention, the second display signal represents 
on-screen data comprising a row of tabs, each including an id symbol which represents 
one of the programs. The representative frames corresponding to the user-selected 
program are arranged in row and column fashion. In another embodiment of the 



invention, the representative frames are arranged in an overlapping manner. The tab 
corresponding to the user-selected program is visually distinct from the remaining tabs. 

In an embodiment of the invention, the frames represented by the third 
display signal are scaled to full-screen. In another embodiment, the scaling is in 
accordance with a user-specified scale factor. 

In another aspect of the invention, the information recording device 
includes an input module for recording content onto the storage device. In this aspect of 
the invention, the content is organized into user-defined streams. The second signal 
comprises a representative frame from each of the streams. 

The present invention allows the user to look through the contents of 
programs on a storage medium in a manner that facilitates quick switching between 
programs. The present invention also facilitates searching and selecting by the use of 
simple operations. 

Also, program symbols or identifiers that can identify programs and 
representative frames of scenes are not displayed manually, and are instead performed 
through unified means based on the data from the recording medium. Thus, it is possible 
to eliminate the inconveniences caused by different interfaces and the like based on 
variations in display methods between individual recording media resulting from the 
intentions of the program producers. 

Of course, appropriate modifications and the like can be made to the 
playing back and displaying of representative frames in order to allow confirmation of the 
display contents and the like. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The teachings of the present invention can be readily understood by 
considering the following detailed description in conjunction with the accompanying 
drawings: 

Fig. 1 is a block diagram for the purpose of describing a first embodiment 
of an information playback device and an information recording/playback device 
according to the present invention; 

Fig. 2 shows a button arrangement figure for the purpose of describing a 
remote control used in the embodiment; 

Fig. 3 is a figure showing a sample video selection screen from a first 

embodiment; 



Fig. 4 is a flowchart for the purpose of describing the operations 
performed by a selection screen display program according to the present invention; 

Fig. 5 is a figure showing an example of a multi-angle selection screen.; 
Fig. 6 is a figure showing an example of an audio information selection 

screen; 

Fig. 7 is a block diagram for the purpose of describing a second 
embodiment of the present invention; 

Fig. 8 is a drawing for the purpose of showing an example of a video 
selection screen according to a third embodiment of the present invention; 

Fig. 9 is a drawing for the purpose of showing an example of a video 
selection screen according to a sixth embodiment of the present invention; 

Fig. 10 is a drawing showing an example of a video selection screen for a 
seventh embodiment of the present invention; 

Fig. 1 1 is a flowchart for the purpose of describing an algorithm used in a 
seventh embodiment of the present invention; 

Fig. 12 is a flowchart for the purpose of describing the operations 
performed in a title selection screen and a chapter selection screen used in a seventh 
embodiment of the present invention; 

Fig. 13 is a figure showing an example of a video selection screen used in 
a seventh embodiment of the present invention; 

Fig. 14 is a drawing showing an example of a video selection screen used 
in a seventh embodiment of the present invention; 

Fig. 15 is a drawing for the purpose of describing an example of a 
representative frame or a starting frame used in an embodiment of the present invention; 

Fig. 16 is a drawing for the purpose of describing an example of a 
representative frame or a starting frame used in an embodiment of the present invention; 

Fig. 17 is a drawing for the purpose of describing an example of a 
representative frame or a starting frame used in an embodiment of the present invention; 
and 

Fig. 18 is a drawing for the purpose of describing an example of a 
representative frame or a starting frame used in an embodiment of the present invention. 



DESCRIPTION OF THE SPECIFIC EMBODIMENTS 
The following is a detailed description of the embodiments of the present 
invention, with references to the figures showing a number of embodiments of the 
information playback device and the information recording/playback device according to 
5 the present invention. In Fig. 1 through Fig. 18, elements labeled with the same numerals 
indicate identical or similar elements. 

<Embodiment 1> 

The following is a description of an embodiment in which the present 
invention is implemented for a playback device in a DVD system. 
10 In the embodiment below, the description will use a starting frame 

displayed at the beginning of a scene as a representative frame or as a representative 
small frame. 

Fig. 1 shows: a driver module 1 playing back an information signal from a 
position on a disk corresponding to a specified address; a buffer module 2 temporarily 

1 5 storing the information signal output from the driver module 1 ; a decoder module 3 
decoding images and audio from the information signal from the buffer module 2; a 
random access memory (hereinafter referred to as "RAM") 4 storing data while the 
decoder module 3 is operating; a digital/analog converter (hereinafter referred to as "D/A 
converter") 5 converting digital signals of images output from the decoder module 3 into 

20 analog signals; a display device 6 displaying an image analog signal from the D/A 

converter 5; a D/A converter 7 converting the audio digital signal output from the decoder 
module 3 to an analog signal; and a speaker 8 playing back the audio analog signal from 
the D/A converter 7. 

Furthermore, the same figure also shows: a system control module 9 

25 controlling the operations of the driver module 1, the buffer module 2, and the decoder 
module 3; a user interface module 1 1 using user instruction inputs to generate control 
signals and transferring these control signals to the system control module 9; a read-only 
memory (hereinafter referred to as "ROM") 12 in which are pre-stored data and programs 
for controlling the sequences of operations performed by the system control module 9; 

30 and a RAM 13 storing data used during operation of the system control module 9. The 

driver module 1, the buffer module 2, the decoder module 3, the system control module 9, 
the user interface module 1 1, the ROM 12, and the RAM 13 are connected to each other 
by a bus line 10. 



5 



The decoder 2 that is used here can reduce the size of an image when 

decoding image signals. 

In addition to standard control programs and control data for the system 
control module 9, the ROM 12 contains a selection screen display program 121 and an 

5 OSD data 122 according to the present invention. The OSD data 122 is data for a screen 
superimposed on playback images (hereinafter referred to as "OSD (On Screen Display) 
screens"). The RAM 13 contains: an address data area 131 storing address data indicating 
the playback starting positions of titles of images recorded on a disk and address data 
indicating playback starting positions for chapters; and an OSD work area 132 storing 

10 OSD data converted into bitmap data to be displayed on screen. These will be described 
in detail later. Furthermore, the RAM 4 contains a display screen area 401 holding data 
for selection screens formed by combining the OSD bitmap data and image data. 

The user interface module 1 1 includes a remote control unit (hereinafter 
referred to as the remote control) used by a user to enter instructions and an infrared 

1 5 transmission path to transmit the control signals generated by the remote control to the 
playback device. The arrangement of the input buttons on the remote control is shown in 
Fig. 2. 

The input buttons on the remote control 201 include: a playback button 22 
for playing back a disk; a list button 23 for selecting an image to view; a select button 25 
20 for selecting and entering an image from the images (selection images) displayed by 

pressing the list button 23; a stop button 26 for stopping image playback; an angle button 
28 for selecting multi-angle images; an audio button 29 for selecting audio playback 
conditions; and cursor buttons 27 used to select an image or a symbol from the screens 
displayed when the list button 23, the multi-angle button 28, or the audio button 29 is 

25 pressed. Controls signals based on user instructions are generated by the user pressing 
these buttons. The cursor buttons 27 are an arrangement of buttons to allow a selection to 
be moved up or down and left or right on the screen. Additionally provided are a cue 
button 24 for playing back an image by entering an address when the address of the image 
to be viewed is known beforehand, and a record button 30 to begin recording. Fig. 3 

30 shows an example of a selection screen obtained by running the selection screen display 
program 121 (see Fig. 1) of the present invention. In a selection screen 17, the symbols 
for individual titles stored on the disk are displayed as numbers in frames (hereinafter 
referred to as tags) 18 at the upper part of the screen, and starting frames 19 of individual 
chapters of titles are displayed in a reduced size. The reduced frames will hereinafter be 




referred to as small frames. In this example, there are three titles. The second title is 
selected and its tag 18b is displayed brighter. The small frames 19a - 19i for the nine 
chapters in the title are displayed, and the second small frame 19b is selected. While four 
tags can be displayed, there are only three titles so the fourth tag 18d is not labeled. The 
5 OSD screen includes the tags 18, the numerals displayed in the tags, the chapter numbers 
for small frames 19a - 19i (CHI - CH9), and the borders separating the small frames. The 
OSD does not include the small frames. Next, the operations performed by the system 
control module 1 1 according to the selection screen display program 121 will be 
described, with references to the flowchart shown in Fig. 4. The operations begin with 
10 the address data indicating playback starting positions for all titles and all chapters of the 
images recorded on the DVD disk being stored in the address data area 131 of the RAM 
13. The storing of address data can be performed after the playback device is tumed on, a 
O disk is mounted, and the playback button 22 of the remote control 201 is pressed. The 

m address data can be obtained directly from the buffer 2 without going through the decoder 

f 15 3 (see Fig. 1). 

M= In the description below, the title numbers stored in the disk will be 

SI represented by "n" and the chapter numbers of these titles will be represented by "m". 

1^ When the user presses the list button 23 of the remote control 201 (S41), 

ffl the OSD screen data for the number of tags displayed on a screen (four in the case of the 

ffj 20 example shown in Fig. 3) is retrieved from the OSD data 122 of the ROM 12. This is 
O converted into bitmap data to be displayed on the screen and is transferred to the OSD 

work area 132 of the RAM 13 (S42). This stored OSD screen data is then sent to the 
decoder 3 (S43). The decoder 3 stores the received data in the display screen area 401 
(S44). At this point, the decoder 3 is informed of the number of titles recorded on the 
25 disk and a reference value for brightness levels used in displaying the small-frame images 
for the selection screen. When playback is begun and the increasing brightness level 
reaches the reference value, the corresponding small-frame image is used in the selection 
screen as the starting frame for the chapter. The decoder 3 uses the given number of titles 
to sequentially insert title numbers, and this data is stored in the display screen area 401. 
30 The use of numbers as the symbols representing title numbers is just one method. Of 

course, depending on the purpose, it would also be possible to use other types of symbols 
or simple identifiers or names that allow programs to be identified. 

Next, the address data for the first chapter (m=l) of the first title (n=l) is 
retrieved from the address data area 131 and is sent to the driver module 1 and the 




decoder module 3 (S45). The driver module 1 begins playing back the information 
starting at the playback starting position of the disk corresponding to the address data 
(S46). The decoder 3 reduces the image of the playback signal and stores the small-frame 
image data in the display frame area 401. The small-frame image data is stored in a 
5 predetermined position in the display screen area 401 so that the small- frame image is 
placed at a position (19a in Fig. 3) in the selection screen corresponding to the chapter 
number (m=l). The decoder 3 also stores the data for the increased brightness in the tag 
of title 1 in the display screen area 401. 

Then, similar operations are performed to place a small-frame image of the 

10 next chapter (m=2) at the corresponding chapter number position (the reduced frame 19b 
from the same figure), and this data is stored in the display screen area 401. The small 
frame of each chapter is placed in its appropriate position in this manner, completing the 
selection screen for the first title in the display screen area 401 (S47). 

Next, if the user presses the cursor buttons 27 to select a tag having the 

15 number n, i.e.,. to select the n^*" title (S48), the small frames of the chapters of the title are 
placed in their respective positions, and operation S45 - operation S47 are performed to 
complete the selection screen for the selected title. 

If the user selects a frame using the cursor buttons 27 (S49), the border 
lines around the selected frame are displayed thicker to indicate that the frame is selected. 

20 As described above. Fig. 3 shows a selection screen where n=2 is selected 

and m=2 is selected. If the image that the user wants to view is this chapter, the user 
presses the select button 25 on the remote control 201. This causes a command for 
exiting the selection operation to be sent to the decoder module 3, and the address data for 
the chapter is sent to the driver module 1 (S50). 

25 When this command is received, the decoder module 3 deletes the OSD 

screen data and stops frame reduction operations. The driver module 1 plays back 
information from the corresponding chapter. This causes the images from the chapter to 
be displayed full-screen (S51), and the operation is finished. 

This embodiment is implemented for DVD disks, but the present invention 

30 is not restricted to this. The present invention can also provide similar advantages when 
implemented for other recording media in which title data is recorded beforehand, e.g., 
other types of disks and tape media as well as semiconductor-based recording media such 
as memory. 



The selection screen described above is the same regardless of what 
recording media is used to record title data. Thus, the present invention allov^s the user to 
select programs to be viewed using a common set of operations. 

Also, the user can look through multiple chapters of a title, and titles can 
5 be selected quickly using buttons. Thus, the contents of all or at least part of the 
programs stored on the disk can be easily known. 

In the present invention, means for selecting frames using multiple 
reduced frames and button operations can also be applied to the selection of playback 
conditions, e.g., selection of multi-angle frames, the selection of audio playback and 
10 languages, and the like. Multi-angle frames are provided in chapters by the program 
producer. In such cases, the availability of the multi-angle feature is displayed in the 
chapter frame and address data for multi-angle frames are output from the disk. 

If the user sees the multi-angle option displayed and presses the multi- 
angle button 28 on the remote control 201 (see Fig. 2), the selection screen display 
15 program 121 replaces the chapter with multi-angle images and performs operation S41 

through operation S51 to arrange and display multiple reduced multi-angle frames. Fig. 5 
shows an example of these type of frames (selection frames). 

The user operates the cursor buttons 27 to select (surround with thick 
lines) an angle frame to view and presses the select button 25. That frame is then played 
20 back full-screen. 

Regarding the selection of playback conditions, the data for the various 
playback conditions are also output when playback of the disk is begun, so multiple 
conditions can be displayed on the screen and selected using the method described above. 

Fig. 6 shows an example of a selection screen where selection of playback 
25 conditions involves making a selection from multiple types of audio. The different types 
of audio are displayed according to the types of audio information. A single screen can 
display a list of audio information types available on the disk, and a desired audio 
information type can be quickly selected. In Fig. 6, the audio information types are listed 
as MPEG, Dolby ACS, and two systems of linear PCM, which are intemational standards 
30 of DVD disk audio formats. Of these, the Dolby AC3 type is selected. 

Next, when the select button 25 is pressed, Dolby AC3 audio is played 

back. 

In addition, the means of the present invention described above can be 
used to display small-frame images for playback condition options instead of displaying 
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,Ke.e playback condiHon opUons (e.g.. audio forma., language, playback mode), thus 
!;::Ue~p.aybackco„diHo„s.obeUs.eda„dse,ec.edus,„g.hesa.e.^^^^^ 

operations that were described above. 

<Embodiment 2> 

Fig 7 shows an embodiment in which information reconiing capabtlmes 
.eaddedtoaplaybackdevice.aecordedinfo™.a.ioncanbeplayedb.ku.^^^^^^^^ 

operations similar to those ftom embodiment 1. The archrtectu. used for playback 
omitted in the figure to simpliiy the drawing. 

in this embodiment, a program is added to the seleCon screen display 
p,osramial.ohavethesystemco„tro,modu,e9saverecordingda.a.F— a 

Liable memory is used for the ROM 12, a.d a recording data area 123. tor stonng 
recording data, is included in the ROM 12. a camera 

When a camera is used to record images, an .mage s.gnal from a cam ra 
,4isc„nvertedtoadigital .mage sis^lby an tmageAA) converter 72. Also a^udio 

signal from a microphone 75 is conver«d .o a digital audio signal by an aud.o AA> 
r I^"3.Theldigita, signals areencodedby an encoder71aadthenrecorded. 

byU-edrivermodulel. Therecordingoperationisstartedbypressingtherecord 
liontheremotecontroUOl.Thepositiononthediskatwhich.^^^^^^^^^ 
started is indica.ed by posi.ion .nformation address data retr.eved f.om the d. k. The 
system control module 9 stores the address data in the recording data area 123 

If the images are to be formed as titles and chapters contained in ..ties, the 
address data for title starting positions are also stored. 

The contents of the r^ording data area 123 are similar .0 the conte^,s o 
the address dataarea 131 whenplaybackis started. Whenperfonninsplayba^^^^^^^ 

,5 from the recording data area 123 is used and the operations m operatton ^ ' « 
from embodiment 1 are performed. d,us allowing .he seleCon of images to be viewed 

^^'™""~"'therecordingda.aareal23canber^rdeda,,a.o„ce 

Tf the disk is to be played back on a different information 

:::l!Lvecanbegenerat^ 
121 modified to retrieve recorded data firom the disk. 
<Embodiment 3> 
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As an example of how a system combining an information 
recording/playback device and a camera can be used, a regular user could record various 
types of events such as weddings, vacations, and school field days. If a stream consists of 
a continuous scene created by pressing the record button 30 of the remote control 201 
5 (see Fig. 2) to begin recording and by pressing the stop button 26 to stop recording, the 
recordings will be a set of a plurality of streams. 

If this set of recordings is referred to as a video program, the recording 
units of a video program could be the event, the date, the time, the location, or the like. 
The units to be used will be based on what the user wants. If the unit used is the date and 
10 time, then time data can be obtained from a clock generally provided inside the 

information recording/playback device, and this data would be converted to symbols 
representing the video program. If the unit used is the event, location, or the like, 
□ character buttons can be provided on the remote control 201, and the user would use these 

S buttons to enter the name (or shortened names) of the event, location, or the like. This 

15 would be converted to symbols representing the video program. 

In this embodiment, a video program formed from a plurality of streams is 
recorded as described above. To playback the recorded program, small-frame images 
representative of the plurality of streams are displayed for each video program, and a 
desired representative small-frame image is selected from the resulting selection screen. 
™i 20 Then, this stream is enlarged full-screen and played back. 

O To implement this embodiment, the encoder module 71 shown in Fig. 7 

and a decoder module not shown in Fig. 7 are both made capable at least of image 
compression/encoding that generates I-pictures. Furthermore, a program is added to the 
selection screen display program 121 shown in Fig. 7 that makes the system control 

25 module 9 perform the operations described below. 

For recording operations, data for the symbol entered by the user for a 
video program as described above are stored in the recording data area 123 (see Fig. 7) of 
the ROM 12. At the same time, the address data for the starting position on the disk of 
the video program is also stored. Furthermore, the address data for the starting positions 

30 on the disk of the streams are also stored in the recording data area 123. This address 
data is the address data obtained from the disk when the record button 30 is pressed to 
record the stream. 

For playback operations, an OSD screen is displayed when the list button 
23 is pressed. The video program symbols stored in the recording data area 123 are 

11 
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displayed in the in the selection screen tags of the OSD screen. Using the symbol data, 
the address data, and the stream address data for the video program stored in the 
recording data area 123, the streams of each video program are played in sequence. The 
first I-picture of a stream is used as the representative small frame displayed on the 
5 selection screen. When an I-picture is displayed, playback of the next stream is started 
immediately. 

In image compression/encoding systems such as MPEGl and MPEG2, 
which are set forth as international standards, video is created from three types of field 
frames: I-pictures, P-pictures, and B-pictures. Of these, compression and encoding in I- 
10 pictures are performed solely v^ithin the frame and can exist independently as static 
images. I-pictures can be obtained from the decoder module 3. 

Fig. 8 shows an example of a selection screen provided by this 
S embodiment. Dates are displayed in the tags, and the first I-pictures from the plurality of 

Streams in the January 1 video program are reduced and displayed as representative small 
15 frames (SI - S9). A fourth representative small frame S4 is displayed. The select button 
25 is pressed to set up the frame to be viewed, and that stream is subsequently played 
m back full-screen from the beginning as in embodiment 1. 

L. The various types of data stored in the recording data area 123 can be 

CP recorded in free space in the disk. If the disk is to be played back on a different 

fjl 20 information recording/playback device or information playback device, the same 
2 selection screens as described above can be generated by providing a selection screen 

displaying program 121 that has been modified to retrieve different types of data from the 

disk. 

Also, the buttons on the remote control 201 can be provided on a side 
25 surface or a rear surface of the camera. This makes the camera easy to use. 
<Embodiment 4> 

The following is a description of an embodiment in which a user-selected 
frame is used as the representative small frame for a stream rather than an I-picture as in 
embodiment 3. After recording a plurality of streams forming a video program to a disk, 
30 these streams are played back. When a frame that the user wants to use as a 

representative frame is displayed, the select button 25 of the remote control 201 is 
pressed. The time between when playback of the stream starts and when the select button 
25 is pressed can be measured using a timer that is generally provided in the information 
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recording/playback device. This time serves as data used to extract the representative 
small frame. 

In this embodiment, the selection screen display program 121 is modified 
from the program in embodiment 3 so that the following operations are performed by the 
5 system control module 9. 

When recording, the time data described above for the frame to be used as 
the representative small frame is stored in the recording data area 123 or a predetermined 
free area in the disk. During playback, the representative small frames are retrieved using 
the data stored in the recording data area 123 or the free space on the disk and displayed 
10 in the selection screen. 

The representative small frames do not have to all be user-selected. 
Certain streams can use I-pictures, and the user can indicate which method to use. If all 
the representative small frames are to be selected by the user, it would of course be 
possible to use a compression/encoding system that does not generate I-pictures. 
15 <Embodiment 5> 

The following is a description of an embodiment where, for each stream, 
the user provides an independently created static image or character image to serve as the 
representative small frame for the stream, and this is recorded onto the disk. 

In addition to using a static image mode on a camera, a static image can be 
20 produced using a dedicated static image camera (e.g., an electronic still camera), a 
scanner, or the like. Character images can be produced through keyboard entry. 

In this embodiment, an area that is large enough to hold static images or 
character images is set up in the recording data area 123 or the free space of the disk. In 
addition, a table is set up to associate the static images or character images with their 
25 corresponding streams. 

The selection screen image display program 121 of this embodiment is 
modified from the program in embodiment 3 so that the system control module 9 
performs the following operations. 

After shooting a video program made up of a plurality of streams, static 
30 images or character images are created for the streams, and these are stored in the free 
area described above. When doing this, the area is placed in a data standby state so that 
data can be recorded into the table described above. Next, as described in reference to 
embodiment 2, the disk is played back and a selection screen for the corresponding video 
program is displayed. A selection is made from the small frames for the streams, and the 
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select button 25 is pressed. If the select button 25 is pressed while the data standby state 
is in effect, the stream is not played back and instead the starting position address data for 
the stream resulting from the frame selection is sent to the area where the standby state is 
in effect. The address data is recorded into the table as data associating the stream with a 
5 stored static image or character image. Then the area is released from the standby state. 

In this manner, the table is completed by associating each stream with a 
static image or a character image. 

During playback, the address data for streams are retrieved. The table is 
used to extract the static image or character image associated with the data, and this is 
10 then displayed as a representative small frame. 

Of course with this embodiment as well, the compression/encoding system 
can be a method that does not generate I-pictures. 
O <Embodiment 6> 

S The following is a description where a plurality of streams is grouped 

% 1 5 together and a single representative small frame is obtained from the set of streams. In 
M= this case, the set of streams forms a sub-program, and a single video program is formed 

p from a plurality of sub-programs. In other words, there is a hierarchical structure of 

L stream, sub-program, and video program. 

O 

g] In this embodiment, symbols are applied to a sub-program each time a 

}fi 20 sub-program is formed, and the streams in the sub-program are played back to allow the 
^ user to select one representative small frame. 

The selection screen display program 121 of this embodiment is modified 

from the program in embodiment 3 so that the system control module 9 performs the 

following operations. 

25 The disk is played back as described with reference to embodiment 2, and 

a corresponding selection screen for the video program is displayed. Next, symbols to be 
assigned to the sub-programs that will be formed are set up. The user selects the symbols 
to be numbers, time or date, events, locations, or the like. The symbol data are 
determined by having the user enter symbols using the buttons. Next, the user selects 

30 streams from the selection screen to be included in a sub-program and presses the select 
button 25. When the selection of the streams is completed, the select button 25 is pressed 
twice. This indicates that the sub-program is completed. 

Before the sub-program is completed, the data for the video program 
symbols, the starting position address data, the symbolic data for the sub-program, and 
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the starting position address data for each of the plurality of streams in the sub-program 
are associated with each other and stored in the recording data area 123 or free space in 
the disk. Next, the plurality of streams corresponding to the completed sub-program is 
played back, and the user selects a single representative small frame. As with 
embodiment 4, this representative small frame data is indicated by the time elapsed from 
the start time of the stream, and this time data is stored in association with the items of 
data described above. 

By using the relational data stored in this manner, selected frames for sub- 
programs can be displayed. The selected frames are similar to those from Fig. 8, and an 
example is shown in Fig. 9. The code SUB on the representative small frames indicate 
that they are for sub-programs, and the user-selected small frames are displayed there. 
Instead of SUB, the displayed code can be a symbol provided for the sub-program. 

When the user selects a desired representative small frame, the story 
contained in the sub-program is played back in sequence. 

In addition, the relational data described above can be used to display sub- 
program symbols in tags. For each sub-program, selected frames can be displayed for the 
plurality of streams in the sub-program. 

This embodiment is useful when a video program is created from a very 
large number of streams. 

Of course in this embodiment as well, the compression/encoding system 
can be a system that does not generate I-pictures. 

Conversely, a system that generates I-pictures can be used as the 
compression/encoding system, and instead of having the user select the representative 
small frames, the first I-picture from a selected stream can be used as the representative 
small frame. 

Also, an image displaying representative small frames can itself be a single 

image file. 

Furthermore, it would also be possible to place the representative small 
frame for a stream inside the stream or near the stream, forming a one-to-one 
correspondence between the stream and its representative small frame. Then, the 
representative small frames for the streams can be collected to create the selection screen. 
In this case, if streams are deleted or added, the selection screen is newly created by 
collecting the representative small frames for the streams. Thus, the adding and deleting 
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of streams can be performed more easily than creating the selection screen as a single 
image file. 

<Embodiment 7> 

Fig. 10 shows another embodiment of a selection screen obtained by 
running the selection screen display program 121 (see Fig. 1) of the present invention. 

In the selection screen 17, numbers are displayed in the frames (hereinafter 
referred to as "tags") 1 8 at the upper part of the screen based on the number of titles 
stored on the disk, and representative frames 19 from the titles are displayed. In this 
example, the disk contains 18 titles, and representative frames 19a - 19i are displayed 
from the nine titles, from title number 1 through title number 9. 

The display brightness of the title number 2 is increased (a highlighted 
display section 62) in order to indicate that the second title number 2 (19b) is selected. 

The title number of the selected title and the total number of chapters in 
the title are displayed in a detailed display section 63. 

In this example, four tags can be displayed in one screen. In a display for 
18 titles, the first tag can be assigned, for example, title number 1 through title number 9 
,and the second tag can be assigned title number 10 through title number 18. In this 
example, the third and fourth tags are not displayed. Of course, the display method can 
be changed as appropriate, e.g., display the tag frame but do not add the title numbers. 

The OSD screen includes the tags 18, the numerals displayed in the tags, 
the title numbers for small frames 19a - 19i (Title 1 - Title 9), and the borders separating 
the small frames. The OSD screen does not include the small frames. The following is a 
description of the operations performed by the system control module 1 1 according to the 
selection frame display program 121 of the present invention, with references to the 
flowchart shown in Fig. 1 1 . 

The operations begin, for example, after the address data indicating title 
and chapter playback starting positions of the images recorded on the DVD disk have 
been stored in the address data area 131 of the RAM 13. The storing of the address data 
can be performed, for example, after the playback device is turned on, a disk is mounted, 
and the play button 22 of the remote control 201 is pressed. 

At the start of the operations (SI 10), the system waits for the list button 23 
of the remote control 201 to be pressed by the user (Sill). 
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Up to nine representative frames can be displayed on the display screen. 
Thus, if the number of titles stored on the disk is 10 or more (SI 12), a selection screen for 
selecting a title is displayed (SI 13). 

It would also be possible to eliminate the branching for this step (SI 13) 
5 and always display the title selection screen. 

The title selection screen displays tags (in the case of Fig. 10 the number 
of tags is two) that indicate the range of title numbers displayed on the display screen. 

Playback is started and the representative frame images are used in the 
selection screen as the starting frames for the titles. 
10 When a title is selected from the title selection screen (S114), a chapter 

selection screen is displayed for chapter selection (SI 15). 

Playback is started and the representative frame images are used as the 
chapter images for the selection screen. When a chapter is selected from the chapter 
selection screen (SI 16), the selected chapter is played back (SI 17), and the operation is 
15 completed (SI 18). 

If there is only one chapter in the title selected from the title selection 
screen, it would also be possible to have the playback of the title begun immediately 
without going through the chapter selection screen. 

If the list button 23 of the remote control 201 is pressed again without 
20 selecting a title or a chapter, the selection screen is removed and the state from when the 
list button 23 of the remote control 201 was pressed (right before the selection screen was 
displayed) is restored. 

Fig. 12 shows a flowchart describing the operations performed in the title 
selection screen and the chapter selection screen. 
25 At the start of the operation (S 140), the system waits for the user to press 

either the cursor buttons 27 (S 141) or the select button 25 (SI 43) on the remote control 
201. If a cursor button 27 is pressed, the brightness of the representative frame title 
number in the title selection screen or the representative frame chapter number in the 
chapter selection screen or the tag corresponding to the cursor key (up, down, left, right) 
30 is increased (highlighted display section ), indicating that the item is selected (S142). 

If the button to move the cursor right is pressed when a title number or 
chapter number in the third column is selected, the next title selection screen or chapter 
selection screen is displayed if there is one, and the highlighted display section is set to 
the first column. 
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If the button to move the cursor left is pressed when a title number or 
chapter number in the first column is selected, the previous title selection screen or 
chapter selection screen is displayed if there is one, and the highlighted display section is 
set to the third column. 

If the button to move the cursor up is pressed when a title number or 
chapter number in the first row is selected, the highlighted display section is set to a tag. 

If the button to move the cursor down is pressed when a title number or 
chapter number in the third row is selected, the highlighted display section is not moved. 

If the button to move the cursor right is pressed when the highlighted 
display section is at a tag, the tag to the right is highlighted and the display screen 
corresponding to the tag is displayed if there is a valid tag to the right. For example, if 
the cursor is moved from "titles 1 - 9" to "titles 10 - 18", the frames for the titles 10-18 
are displayed. 

If the button to move the cursor left is pressed when the highlighted 
display section is at a tag, the tag to the left is highlighted and the display screen 
corresponding to the tag is displayed if there is a valid tag to the left. 

If the button to move the cursor up is pressed when the highlighted display 
section is at a tag, the highlighted display section does not move. 

If the button to move the cursor down is pressed when the highlighted 
display section is at a tag, the highlighted display section is moved to a title number or a 
chapter number in the first row. 

If there is no button input for at least a second (SI 14), the video for the 
title number or the chapter number is played back as a small frame (S145). 

Playback can be performed as normal playback, fi-ame-by- frame 
advancing playback, slow playback, skipping playback, fast-forward playback, and the 
like. The playback need not be restricted to the small-frame images for the highlighted 
title number or chapter number, and can be performed for any of the small frames 
displayed in the selection screen 17. 

This playback of a small frame can be performed with or without audio. 

In this embodiment, fast-forward playback with no audio is used. 

After playing a title or chapter to the end, the system can be set up so that 
the title or the chapter is played back again from the starting position of the title or 
chapter (repeat playback). 
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The time limit for button input can, of course, be any interval including 0 

seconds. 

If the select button is pressed, the highlighted title number or chapter 
number is set up as the selected title number or chapter number (S 146), and the operation 
5 is done (SI 47). 

If a tag is highlighted when the select button is pressed, a title number or 
chapter number is not selected. In this embodiment, the upper left small frame in the 
selection screen will be selected in such cases. 

In Fig. 10 for the embodiment described above, the representative frames 

10 19a - 19i are small compared to the selection screen 17. However, the representative 
frame 19a can be, for example, the same size as the selection screen 17. In this case, the 
other representative frames 19b - 19i would be displayed on top of the representative 
frame 19a. The tags 18 shown in Fig. 10 may be eliminated. The tags 18 are not required 
and other display methods can be used as long as they allow titles to be identified and 

15 selected. 

In the description of the above embodiment, the starting frames are 
displayed in the selection screen as small frames, but the present invention is not 
restricted to this. It would also be possible to display multiple starting frames at any 
reduction rate and to have these displayed in an overlapping manner. When a frame is 
20 selected, it would be played back and displayed fiiU-screen. An example of this is shown 
in Fig. 13. 

Of course, it would also be possible to have one of the starting frames 

displayed fiiU-screen while the other starting frames are displayed overlapping over it. 

An example of this is shovra in Fig. 14. 
25 It would also be possible to use a section cut out from a fiiU-screen image 

and used as a representative frame or a starting frame. An example of this will be 

described below, with references to Fig. 1 5 through Fig. 18. 

Fig. 15 shows a representative frame 19as and a representative frame 19am 

cut out from a full-screen image using the center of the image as a reference. 
30 Fig. 16 shows a representative frame 19as and a representative frame 19am 

cut out from a fiiU-screen image using the lower right comer as a reference. The 

reference position does not have to be the lower right comer and can instead be the lower 

left comer, the upper right comer, or the upper left comer. 
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In Fig. 17, the representative frame 19am from Fig. 16 is used as the 
representative frame 19a displayed in the selection screen 17. The original size is 
retained. 

In Fig. 18, the representative frame 19am from Fig. 16 is used as the 
representative frame 19a displayed in the selection screen 17. The size of the cut-out is 
enlarged. 

In the descriptions for Fig. 17 an Fig. 18, the representative frame 19am 
from Fig. 16 was used, but it would also be possible to use the representative frame 19as 
from Fig. 16, the representative frame 19am from Fig. 15, or the representative frame 
19as from Fig. 15. 

In the above description, the center, the lower right comer, the lower left 
comer, the upper right comer, or the upper left comer of the frame is used as a reference 
for cutting out a section. However, these positions were used as references in the 
description just to simplify the description. 

Thus, the position to be used as a reference is not restricted to these 
positions, and any position on the frame can be used. The reference position can be set 
appropriately to allow the displayed content of the frame to be confirmed. The cut-out 
frame can be cut out from any position and at any size that allows the contents displayed 
in the frame to be confirmed. Also, the frame can be played back and displayed at any 
size. 

Also, in the means used to display symbols corresponding to multiple 
programs recorded on a recording medium, the symbols corresponding to programs need 
not be symbols. Instead, programs can be identified using identifiers or display methods 
that identify programs or through frames associated with programs. 

Furthermore, in the means used to display symbols corresponding to 
multiple programs recorded on a recording medium, symbols need not necessarily be 
displayed on the screen. For example, if the multiple programs recorded on a recording 
medium need not be selected using symbols, there is no need to display symbols 
corresponding to the programs on the screen. Thus, it would be possible to omit the 
means for displaying symbols on the screen corresponding to multiple programs. 

In the description above, DVD disks are used, but the present invention is 
not restricted to this. The present invention can provide similar advantages when 
implemented for other disk recording media, tape recording media, and semiconductor 
media such as memory. 
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Also, in the description above, OSD screens are used, but the present 
invention is not restricted to this. Of course, it would be possible to use any type of 
display method that provides the advantages of the present invention's selection screen, 
the presentation of the representative frames, and the selection operations for 
representative frames. 

According to the present invention, symbols provided for individual 
programs, or identifiers and selected symbols identifying programs, or representative 
frames from a plurality of scenes from a program of an identifier that can identify a 
program are displayed on a screen. This allows the recorded contents to be listed easily, 
and a user can view a video through easy selection operations. 

With regard to the means for reducing the starting frames from multiple 
scenes in a program with a selected symbol and displaying these on the screen, if any 
reduction ratio including no reduction can be used, then it would be possible to allow a 
user to select a video to view by providing a full-screen display of a representative frame 
from one scene from a program while representative frames of other scenes from the 
program are displayed in an overlapping manner over the full-screen frame. 

With regard to the means for displaying on the screen the representative 
frames from multiple scenes in a program using any reduction ratio, it would also be 
possible to allow a user to select a video to view by displaying the representative frames 
of scenes from a program so that they overlap each other. 

Furthermore, the reduction ratio of a selected representative frame can be 
changed to a different reduction ratio and played back. Thus, a user can select a 
representative frame and view the video at a desired size. 

Not all of the representative frames (of the scenes from a program) 
displayed on the screen have to be reduced when displayed on the screen. It would also 
be possible for any one of the representative frames to be displayed full-screen without 
reduction. Furthermore, by playing back and displaying that stream on the screen, the 
contents of all or part of the stream can be understood, thus making selection easier. 

The operations are the same regardless of the recording medium. For 
example, with disks, inconveniences resulting from different operations having to be 
performed for disks can be avoided. 
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